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1.  INTRODUCTION: 


We  consider  the  following  two  dimensional  model: 

<7 

y(m,n)  =  ^2  A°kcos(m\°k  +nn°k)  +  X(m,n);  for  m  =  1, . . .  M,  n  =  1, . . . ,  N,  (1.1) 

k=l 

where  .49,s  are  unknown  real  numbers,  A*  ’s,  yPk  ’s  are  .unknown  frequencies.  For 
identifiability,  we  need  to  assume  X°k  e  (— 7r,  7t)  and  y.°k  e  (0,7r)  and  they  are  distinct. 
X(m,n)  is  a  two  dimensional  (2-D)  stationary  random  field  described  as  follows: 

p  Q 

X(m,n)  =  Y  Y  b(i,j)e(m  —  i,n—  j).  (1.2) 

i=-Pj=-Q 

Here  {e(m,  n)}  is  a  two  dimensional  sequence  of  independent  and  identically  dis¬ 
tributed  ( i.i.d .)  random  variable  with  mean  zero  and  finite  variance.  P  and  Q  are 
arbitrary  positive  integers,  ‘q’,  the  number  of  components,  is  assumed  to  be  a  known 
integer.  Given  a  sample  y(ra,n);m  =  1  ,...,M,n  =  1  the  problem  is  to 

estimate  A°k ’s,  Xk ’s,  /i°’s  for  A;  =  1, . . .  q. 

X(m,  n)  is  a  stationary  random  field  and  y(m,  n)  is  a  non-stationary  random  field. 
To  see  how  this  model  represents  different  textures,  the  readers  are  referred  to  the 
work  of  Mandrekar  and  Zhang23  or  Francos  et  al .5,  where  they  provided  nice  2-D  image 
plots  of  y(m,  n),. whose  grey  level  at  (m,  n)  is  proportional  to  the  value  of  y(m,  n)  and 
when  it  is  corrupted  by  independent  Gaussian  noise  field.  So  this  model  represents 
mixed  textures  of  regular  textures  with  noise  pictures.  Our  problem  is  to  extract 
the  regular  textures  from  the  contaminated  y(m,n).  The  problem  is  of  interest  in 
spectrograph  and  is  studied  using  group  theoretic  methods  by  Malliavan21,22.  Francos 
et  al.5  considered  the  Wold  type  decomposition  of  the  random  fields  due  to  Helson  and 
Lowdenslager8,9,  but  no  concrete  mathematical  results  were  obtained  in  that  paper. 
Mandrekar  and  Zhang23  also  considered  the  spectral  analysis  of  this  problem  under 
the  following  stationary  assumptions  on  X (m,  n) 

X{m,n)  =  Y  £  &(*>  j)e(m  -  i,n- j),  (1.3) 

i=-  oo  j  ~ — oo 

where  {e(m,  n)}  is  a  double  array  sequence  of  independent  random  variables  such 
that 

OO  00 

^2  l^(*,i)|<oo,  E(e(m,n))  =  0,  E(\e(m,n) |r)  <  oo,  (1.4) 

i=— oo  j~—oo 

for  some  constant  r  >  2.  They  proved  that  the  spectral  estimators  of  A’s  and  /x’s  are 
consistent  estimators  of  the  corresponding  parameters  when  X(m,n)  satisfies  (1.3) 
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and  (1.4).  Unfortunately  the  corresponding  estimators  of  the  linear  parameters  (A’s) 
are  not  consistent.  Moreover,  they  could  not  obtain  the  asymptotic  distributions  of 
the  different  estimators.  Therefore,  the  rates  of  convergence  of  those  estimators  are 
not  known.  Their  results  are  mainly  based  on  the  work  of  Lai  and  Wei19,  which 
is  quite  involved  mathematically.  In  this  paper  we  mainly  consider  the  least  squares 
estimators  (LSE’s)  of  the  different  parameters  and  study  their  large  sample  properties. 

In  the  particular  case,  when  {X(m,n)}’s  are  i.i.d.  random  variables  on  a  2-D 
plane,  the  problem  can  be  interpreted  as  ‘signal  extraction’.  It  has  wide  applications 
in  Multidimensional  Signal  Processing.  See  for  example,  the  works  of  Barbieri  and 
Barone2,  Cabrera  and  Bose3,  Chun  and  Bose4  ,  Hua10,  Lang  and  McClellan20,  Kundu 
and  Gupta15  and  see  the  references  there  for  the  different  estimation  procedures  and 
its  applications.  It  is  interesting  to  observe  that  the  model  (1.1)  is  the  2-D  extension 
of  the  one-dimensional  frequency  model,  which  is  a  well  studied  model  in  time  series 
and  analysis,  see  for  example,  the  works  of  Hannan7  and  Walker31  in  this  context. 

In  this  paper,  we  consider  the  least  squares  estimators  (LSE’s)  of  the  unknown 
parameters  of  the  model  (1.1),  under  the  assumption  (1.2)  on  X{m,n).  It  is  well 
known  that  the  LSE’s  play  an  important  role  in  estimation  theory.  It  has  lots  of 
desirable  properties,  like  consistency,  asymptotic  normality,  asymptotic  unbiasedness 
etc.  (see  Rao26).  But  no  where,  at  least  not  known  to  the  authors,  the  properties  of 
the  LSE’s  have  been  discussed  of  this  model  under  this  general  setup.  It  is  important 
to  observe  that  the  model  (1.1)  is  a  non-linear  regression  model,  but  unfortunately  it 
does  not  satisfy  the  standard  sufficient  conditions  stated  by  Jennrich11  or  Wu32  for 
the  LSE’s  to  be  consistent.  It  may  be  noted  that  when  q  =  1,  M  =  1  and  A*  =  0,  this 
model  coincides  with  the  one  dimensional  frequency  model  discussed  in  Hannan7, 
Walker31,  Kundu13  and  Kundu  and  Mitra17.  It  was  shown  in  Kundu13  that  even 
the  one  dimensional  model  does  not  satisfy  the  sufficient  conditions  of  Jennrich11  or 
Wu32.  Therefore,  it  is  not  immediate  how  the  LSE’s  will  behave  in  this  particular  case 
under  this  general  setup.  In  this  paper  it  is  observed  that  the  LSE’s  are  consistent, 
unlike  the  spectral  estimation  method > proposed  by  Mandrekar  and  Zhang23,  where 
the  estimators  of  the  linear  parameters  are  not  consistent.  We  obtain  the  asymptotic 
distributions  of  the  least  squares  estimators,  which  was  not  attempted  before  under 
this  general  conditions  for  the  two  dimensional  model.  The  asymptotic  distributions 
of  the  LSE’s  are  multivariate  normal.  The  asymptotic  distributions  of  the  LSE’s  are 
useful  to  obtain  the  rates  of  convergence  of  LSE’s  of  the  unknown  parameters. 

It  may  be  argued  that  the  assumption  of  Mandrekar  and  Zhang23  on  X  ( m ,  n)  is 
somewhat  weaker  than  ours,  because  in  our  case  P  <  oo  and  Q  <  oo  as  defined  in 
(1.2).  But  since  P  and  Q  are  arbitrary,  therefore  (1.3)  can  be  approximated  arbitrary 
closely  by  (1.2)  with  sufficiently  large  P  and  Q,  see  Fuller6.  Therefore,  for  all  practical 
purposes  they  are  equivalent.  More  over  Mandrekar  and  Zhang23  use  higher  order 
moment  assumptions  (r  >  2)  on  e(m,  n)  to  prove  the  necessary  consistency  results, 
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whereas  we  assume  only  the  finite  second  moment  of  e(m,  n),  to  prove  the  consistency 
and  the  asymptotic  normality  of  the  LSE’s  of  all  the  unknown  parameters.  In  this 
paper  the  almost  sure  convergence  means  with  respect  to  the  usual  Lebesgue  measure 
and  it  will  be  denoted  by  a.s.  We  will  denote  the  set  of  positive  integers  by  Z.  Also 
the  notation  a  =  0(b(M,  N)),  means,  \a/b(M,  N)\  is  bounded  for  all  M  and  N. 

The  rest  of  the  paper  is  organized  as  follows.  In  Section  2,  we  prove  the  strong 
consistency  and  in  Section  3  we  obtain  the  asymptotic  distributions  of  the  LSE’s  of 
the  parameters  of  the  model  (1.1),  when  q  =  1.  For  q  >  1,  the  results  are  obtained 
in  Section  4.  We  perform  some  numerical  experiments  and  present  those  results  in 
Section  5  and  finally  we  draw  conclusions  from  our  work  and  propose  some  open 
problems  in  Section  6. 


2.  CONSISTENCY  OF  THE  LSE’S: 


In  this  section,  we  obtain  the  consistency  of  the  LSE’s  of  the  unknown  parameters 
of  the  model  (1.1),  when  q  =  1,  i.e., 

y(m,n)  =  A°cos(mX° nfjP)  +  X(m,n)]  for  m  —  1, . . .  M,  n  =  1, . . . ,  N. 

The  LSE’s  are  obtained  by  minimizing  Q(6),  where 

M  N 

Q{9)  =  5Z  (y(m’ n)  -  Acos{m\  +  nn))2 .  (2.1) 

m=l n= l 

Here  9  =  the  true  parameter  value  and  the  LSE  of  9  are  denoted  by  9°  = 

(A0,\0,fJ?)  and  9  =  (A,  A,  fi)  respectively.  We  make  it  explicit  the  assumptions  on 
X ( m ,  n)  as  follows. 

i 

Assumption  1:  Let  {A(m,  n);  m,  n  G  Z}  be  a  stationary  random  field  and  each 
X(m,n)  can  be  represented  as  (1.2),  { e(m,n);m,n  €  Z}  is  a  double  array  sequence 
of  i.i.d.  random  variables  with  mean  zero  and  variance  a2. 

We  use  the  following  lemma  to  prove  the  necessary  results. 

Lemma  1  If  the  double  array  sequence  {X(ra,n);ra,n  €  Z}  satisfy  Assumption  1, 
then 

j  i  M  N 

sup  Itttt  ^2  ^  X (m,  n)cos(ma)cos(n(3)  \  ^4'  0  when  min{M,N}  — >  oo. 

0,0  N  M  m=i  n=i 

Proof:  See  Appendix. 
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Note  that  the  Lemma  1.  is  a  very  strong  result.  It  extends  some  of  the  existing 
one  dimensional  results  of  Hannan7,  Walker31,  Rao  and  Zhao28,  Kundu13  and  Kundu 
and  Mitra17,18  to  the  2-D  case.  It  also  generalizes  the  multidimensional  results  of  Bai 
et  al.1,  Rao  et  al .29,  Kundu  and  Mitra16  and  Kundu  and  Gupta15  in  some  sense. 

Consider  the  following  assumption  on  the  parameters  of  the  model  (1.1),  when  q  =  1. 

Assumption  2:  Let  A°  be  a  arbitrary  real  number  not  identically  equal  to  zero,  A° 
e  ( — 7r,  7r)  and  /i°  €  (0,tt). 

Now  we  state  the  consistency  result  as  the  following  theorem. 

Theorem  1:  Under  the  assumptions  1  and  2,  the  least  squares  estimators  of  the 
parameters  of  the  model  (1.1)  when  q  =  1,  are  strongly  consistent. 

Proof  of  Theorem  1:  Expanding  (2.1),  with  the  help  of  Lemma  1  and  using  the 
similar  technique  as  of  Bai  et  al.1,  the  results  can  be  obtained. 

It  is  interesting  to  observe  that  although  the  errors  are  correlated  the  usual  LSE’s 
provide  consistent  solutions.  For  the  general  linear  or  non-linear  models  if  the  errors 
are  correlated,  it  is  well  known  (Rao26,  Seber  and  Wild30)  that  the  usual  LSE’s  are 
inconsistent.  In  the  correlated  case,  we  need  to  consider  the  generalized  least  squares 
estimators,  which  are  consistent.  On  the  other  hand,  theorem  1,  may  not  be  too 
surprising,  because  it  is  known  (Kundu14)  that  for  one-dimensional  frequency  model, 
even  if  the  errors  are  correlated,  the  LSE’s  are  consistent.  In  this  respect  one  or  higher 
dimensional  frequency  models  are  quite  different  than  the  usual  non-linear  models. 


3.  ASYMPTOTIC  NORMALITY  OF  THE  LSE’S: 


In  this  section  we  obtain  the  asymptotic  distributions  of  the  least  squares  estima¬ 
tors  of  the  parameters  of  the  model  (1.1)  when  q  =  1.  We  use  the  following  notations. 
The  first  derivative  of  Q(9)  is  a  1  x  3  vector  as 


Q'{9) 


6Q{9)  5Q(Q)  5Q(dy 
8A  ’  6X  ’  6fj, 
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and  the  second  derivative  is  a  3  x  3,  matrix  as  follows; 


S2Q(9) 

52Q{6) 

S2Q{9 )  I 

SA 2 

5  ASX 

5A6n 

Q"(0)  = 

S2Q{9 ) 

S2Q{9) 

S2Q{9) 

SX5A 

SX2 

SXSn 

S2Q{9) 

S2Q{9) 

S2Q(9) 

StiSA 

6n6\ 

tf/i2  J 

Therefore  expanding  Q'(9)  around  9°,  we  obtain 

Q'{6)  -  Q'(6° )  =  (9-  9°)Q"(9) 


(3.1) 


where  9  is  a  point  on  the  line  joining  between  the  points  9  and  9°.  Note  that  Q'(9) 
=  0  and  consider  the  3  x  3  diagonal  matrix  D  as  follows. 


D  = 


M-iiV-i 

0 

0 


0 

M-fyv-i 

0 


0 

0 


Now  (3.1)  can  be  written  as 


(0  -  0»)  = -Q'W  [t?"(0)]  ‘  (3.2) 

if  Q"{9)  is  a  full  rank  matrix  (see  at  the  end  of  this  section).  Equivalently 

(9  -  9°)D~1  =  -[Q,(0°)D][DQ"(0)D]-1.  (3.3) 

Now  let’s  consider  different  elements  of  [Q'(0°)D]. 


1  5Qjf) 
SA 

1  6Q(0°) 

SX 

1  6Q{9) 

AfiiVi  5n 


_2  ,  M  N 

771  ..i  J2X(m,n)cos(m\  +  nn), 
m=ln=1 
2  M  N 

— 3 — -  ^2  X(m,  n)Amsin(m\  +  n//), 

M2N2m=ln=l 


_ 2 _ 


M  N 


EE 


X(m,  n)Ansin(m\  +  ti/j,). 


Using  the  central  limit  theorem  of  the  stochastic  process  (see  Fulle6),  and  using  the 
following  results  of  Mangulis24  for  /3  ^  0, 


lim  \  tcos2(tP)  =  lim  -^Y'  tsin2(t/3)  =  - 

n-+oo  v  n-»oo  r.2  ^  d 


n~*°°  n  t=L 


lim  XI  t2cos2(td)  =  lim  4r  XI  t2sin2(tp)  =  - 
n-fO0  n3  “  n3  ~  6 

1  n 

Jim  —  XI  tsin(t/3)cos(tP)  =  0 
n-*-°o  n  t=1 

it  follows  that  [<^/(^°)D]  tends  to  a  3-variate  normal  distribution  with  mean  vector 
zero  and  the  dispersion  matrix  2cr2c£.  where 


P  Q 

2 

P  Q 

= 

£  £  b(i,j)cos(iX°)cos{jfi° ) 

i=-Pj=-Q 

+ 

£  £  b(i,j)cos(i\°)sin(jiJ?) 

i=—Pj=—Q 

p  Q 

2 

p  Q  n 

+ 

X]  £  b(i,  j)sin(i\°)cos(j fi°) 
i=-Pj--Q 

+ 

£  £  b(i,j)sin(i\°)sin(jn°) 

i~—P  j=—Q 

'  1  0  0 
£  =  0  ±A°2  \A° 2 


0  \A°2  ±A°2 


Observe  that  because  of  theorem  1,  9  converges  to  9 0  a.s.  and 

MlimM(DQ”WD)=Mlimoo(DQ"(0»)D)=S. 


Af,iV— kx> 


Therefore  from  (3.3),  we  have  the  following  result 

'  1  l  * 

Theorem  2:  Under  the  assumptions  1  and  2,  the  limiting  distribution  of  {M«  N*  (A— 
A0),  M*nH A  -  A0),  M2iV3(/ i  -  //>)}  as  Min(M,N)  -4  oo,  is  a  3-variate  normal 
with  mean  vector  zero  and  covariance  matrix  2a2cS_1,  when  E-1  has  the  following 
structure: 

no  0  1 


m  = 


0 

u  7  ^ 


n  36  1 
0  -~1& 


Note  that  to  prove  theorem  2,  we  use  the  fact  Q'{9 )  is  a  full  rank  matrix  a.s.  for 
large  M  and  N.  In  fact,  we  have  used  DQ"(0)D  is  of  full  rank  a.s.  (see  (3.3)).  Now 
from  (3.6),  it  is  clear  that  for  large  M  and  N,  DQ"(9°)D  is  a  full  rank  matrix.  Since, 
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the  elements  of  the  matrix  Q"{9)  are  continuous  functions  of  9  and  9  converges  to  9° 
a.s.,  therefore  DQW(^)D  is  a  full  rank  matrix  a.s.  for  large  M  and  N. 

From  theorem  2,  it  is  clear  that  the  LSE  of  the  amplitude  (A’s)  is  asymptotically 
independent  with  the  LSE’s  of  the  frequencies.  Where  as,  the  LSE’s  of  the  two 
frequencies  have  a  high  negative  correlation.  The  asymptotic  variances  of  the  LSE’s 
of  A,  A  and  //  are  proportional  to  -3^o2  and  respectively.  Therefore,  it 

is  immediate  that  the  convergence  rates  of  A  and  ft  are  of  the  orders  0(M-3iV-1)  and 
3)  respectively  and  both  of  them  are  faster  than  the  convergence  rate  of  A, 
which  is  0((MN)~l),  Moreover,  the  asymptotic  variances  of  A  and  p,  are  inversely 
proportional  to  A°2 .  This  may  not  be  very  surprising,  because  if  A°2  is  small,  then  it 
is  difficult  to  estimate  the  frequencies. 


4.  MULTIPARAMETER  CASE: 


In  this  section  we  consider  the  model  (1.1)  for  any  integer  q.  We  use  the  following 
notations 

9\  (Ai,  Aj,  fJ-l),  .  .  .  ,  Oq  =  ( Ag ,  A q,  fJ>q),  'F  =  ($1,  •  •  •  ,  9q) 

The  true  parameter  value  and  the  LSE’s  of  \Er  will  be  denoted  by  'F°  and  'F  respectively. 
We  investigate  the  consistency  and  the  asymptotic  properties  of  'F,  which  is  obtained 
by  minimizing 


M  N  /  q  \  2 

R(y)  =  E  E  y(m » n)  -  £  Akcos(m\k  +  n/ifc) )  (4.1) 

m=l n=l  V  fc=l  / 

with  respect  to  We  need  the  following  assumption. 

Assumption  3:  Let  Aj,...,Ap  be  arbitrary  real  numbers  not  any  one  of  them 
are  identically  equal  to  zero,  A?,...,A°  e  (-7r,7r)  and  they  are  distinct,  similarly 
Hi, . . . ,  fi°  €  (0,  it)  and  they  are  distinct. 

The  following  result  provides  the  consistency  results  of  the  LSE’s  of  the  model  pa¬ 
rameter  for  the  general  case. 

Theorem  3:  Under  assumptions  1  and  3,  'F  is  a  strongly  consistent  estimator  of  'F°. 

Proof:  It  is  quite  similar  to  the  proof  of  Theorem  1,  so  it  is  omitted. 

To  establish  the  asymptotic  distribution  of  we  use  the  following  notations.  The 
3 q  x  3 q  diagonal  matrix  V  and  the  3 q  x  3 q  block  diagonal  matrix  $_1  are  defined  as 
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follows. 


D  . 

..  0 

,*‘l  = 

ciEr1  . 

0 

0  . 

..  D 

0 

fyE"1 

where  E"1  can  be  obtained  from  E-1  defined  in  (3.6)  by  replacing  A°2  with  A*-2  and 
similarly  c*’ s  can  be  obtained  from  c’s  defined  in  (3.4)  by  replacing  A0  and  /. r  with 
Xk  and  fi°k  respectively. 

Theorem  4:  Under  the  same  assumptions  as  Theorem  3,  ('F  —  4/°)V-1  converges 
to  a  3^-variate  normal  distribution  with  mean  vector  zero  and  the  dispersion  matrix 
2ct2<$-1,  where  V-1  and  $_1  are  as  defined  above. 

Proof:  The  proof  can  be  obtained  quite  similarly  as  Theorem  2,  so  it  is  omitted. 


5.  NUMERICAL  EXPERIMENTS  AND  DISCUSSIONS: 


In  this  section  we  present  some  results  of  the  numerical  experiments  performed  to 
see  how  the  asymptotic  results  behave  for  finite  sample  sizes.  We  performed  all  the 
experiments  in  Silicon  Graphics,  using  the  random  deviate  generator  of  Press  et  al.25. 
We  considered  the  following  model: 

y(m,  n)  =  4.0cos(2.0m  +  l.On)  +  5.0cos(2.5m  +  1.5n)  +  X(m,  n ),  (5.1) 

X  (m,  n)  has  the  following  form 

X(m,n)  =  e(m,n)  +  .25e(ra-l,n)  +  .25e(m  +  l,n)  +  .25e(ra,  n  — l)  +  .25e(m,  n  +  1) 

{e(m,  n);m  =  1  =  1  are  i.i.d.  Gaussian  random  variables  with 

mean  zero  and  finite  variance  a2.  The  stationary  random  field  X (m,n)  has  that 
particular  structure  indicates  that  the  error  at  the  point  (m,  n)  is  equally  influenced 
by  the  four  equidistant  points  from  (m,  n).  We  considered  M  =  N  =  10, 20, 30, 40, 50 
and  a  =  .25,  .50,  .75,  1.0.  For  each  sample  size  and  for  each  a  we  computed  the 
LSE’s  of  Ai,  Az,  Ai,  A2,  Hi  and  /j2  and  observed  the  average  estimates  and  the  average 
mean  squared  errors  (MSE’s)  over  five  hundred  replications.  We  present  the  results 
in  Tables  1-5.  We  also  report  the  asymptotic  variances  (ASV)  for  each  parameters 
for  comparison  purposes. 

From  the  simulations  it  became  very  clear  that  as  sample  size  increases  or  the 
variance  decreases,  the  average  MSE’s  and  biases  of  all  the  estimators  decrease.  It 
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shows  that  all  the  estimators  are  consistent  and  asymptotically  unbiased.  Biases  are 
quite  small  even  when  the  sample  sizes  are  quite  small.  It  is  clear  that  the  MSE’s 
of  the  estimators  of  the  non-linear  parameters  are  smaller  than  that  of  the  linear 
parameters  even  for  small  sample  sizes.  From  the  experimental  study  also  it  is  clear 
that  the  estimation  of  the  linear  parameters  are  more  difficult  (in  terms  of  accuracy) 
compared  to  the  non-linear  parameters.  Some  of  the  asymptotic  behaviors  are  present 
even  at  small  sample  sizes.  For  example  if  Ax  <  A2,  then  it  is  observed  that  the  MSE’s 
of  fa  and  A2  are  smaller  than  that  of  fa  and  Ai  respectively.  It  is  also  observed  that 
as  sample  size  increases  the  MSE’s  become  closer  to  the  asymptotic  variances,  i.e. 
|ASV  -  MSE  |  decreases.  Therefore  looking  at  the  behavior  of  the  MSE’s  we  can  say 
that  the  asymptotic  results  can  be  used  to  draw  the  small  sample  inferences  for  the 
different  model  parameters.  In  some  of  the  cases  it  is  observed  that  the  ASV  is  lower 
than  the  corresponding  MSE.  This  may  not  be  very  surprising,  since  we  considered 
only  five  hundred  replications,  it  may  be  due  to  the  sampling  errors  (see  Karian  and 
Dudewicz;  [7]). 


6.  CONCLUSIONS: 


In  this  paper  we  consider  the  estimation  of  the  parameters  of  a  two  dimensional 
model,  which  has  wide  applicability  in  Statistical  Signal  Processing  and  in  Texture 
classifications.  We  study  the  asymptotic  properties  of  the  LSE’s  of  the  model  param¬ 
eters  and  show  that  the  LSE’s  are  strongly  consistent.  We  also  obtain  the  asymptotic 
distributions  of  the  LSE’s,  which  provides  the  rate  of  convergence  of  the  LSE’s.  This 
paper  generalizes  some  of  the  existing  one  dimensional  results  to  the  2-D  case.  It 
generalizes  some  of  the  multidimensional  results  also  in  certain  way.  Numerical  ex¬ 
periments  suggest  that  the  asymptotic  results  can  be  used  to  draw  the  small  sample 
inferences  for  the  linear  and  non-linear  parameters.  We  do  not  address  one  important 
problem,  namely  the  estimation  of  ‘q’.  That  is  a  very  important  problem  in  practice. 
We  may  have  to  use  certain  information  theoretic  criteria  like  AIC,  BIC  or  we  may 
have  to  use  the  cross  validation  type  technique  as  proposed  by  Rao  [21]  for  the  one¬ 
dimensional  case.  Another  important  problem  is  to  obtain  an  efficient  estimator  of 
the  different  parameters  by  some  non-iterative  technique.  Non  iterative  techniques 
are  important  for  online  implementations  or  to  use  as  initial  guesses  for  any  iterative 
procedures.  More  work  is  needed  in  these  directions. 
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APPENDIX 


Proof  of  Lemma  1:  First  we  prove  the  result  when  X(m,n)  is  replaced  by  e(m,n ) 

Consider  the  following  random  variables; 

Z(m,n )  =  e(m,n)  if  \X(m,  n)|  <  (ran)* 

=  0  otherwise 

First  we  will  show  that  Z(m,n)  and  e(m,n)  are  equivalent  sequences.  Consider 

OO  00 

£  P{e(m,  n)  #  Z(m,  n)} 

m— 1 n=  I 

OO  OO 

=  ^{|e(r7i, ri)|  >  (ran)*} 

m=l  n=l 

Now  observe  that  there  are  at  most  2k  k  combinations  of  (m,n)’s  such  that  ran  <  2k , 
therefore  we  have 


£  P{|e(m,n)|  >  (mn)?} 


<  ^2  ^2  P{\e(m, n)|  >  r*}  [here  r=mn] 

h=l  2k~l<r<2k 

OO 

<  ^2  k2kP{\e(l,  1)|  >  2^-1^} 

k=l 

<-  i)i2  k  . 

5  cl?2^r-cSiF<0° 

Here  C  is  a  constant  and  note  that  it  may  represent  different  constant  at  different 
places.  Therefore,  e(m,n)  and  Z(m,n)  are  equivalent  sequences.  So 

i 

P{e(m,n)  ^  Z(m,n)  i.o.}  =  0 

Here  i.o.  means  infinitely  often.  Let  U(m,n)=Z(m,n)-E(Z(m,n)),  then 

j  j  M  N 

suPl  H  P{Z(m,  n))cos(ma)cos(nP)\ 

a m=l  n=l 
l  j  M  N 


m=l  n= 1 


Since  E(Z(m,n))  -»  0  as  M,N  oo,  therefore  as  M,N  -4  oo 

j  j  M  N 


m=l  7i=l 


14 


Therefore,  it  is  enough  to  prove  that 


j  j  M  N 

sup|--  Y,U{m,n)cos(ma)cos{n(3)\ ^4'  0 


Now  for  any  fixed  e  >  0,  -n  <  a,  /?  <  7r  and  0  <  h  <  — r,  we  have 

~  2(MN)i 


2(MNy 

1  l  M  N 

S  I]  C/(m,n)cos(mo;)cos(n/?)|  >  e} 

m=l  n=l 
M  N 

<  2e~hMNt  n  n  jjfg  h  U  ( m  ,n )  cos  ( mot )  cos  (n(3 ) 

m=l  7i—  1 

Since  \hU(m, n)cos(ma)cos(n/3)\  <  1/2,  using  ex  <  1  +  x  +  :r2  for  |x|  <  1/2,  we  have 

M  N 

2e~hMNe  JJ  j“J  j£ghU(m,n)cos(rnot)cos(nl3) 

771—  1  71=1 

,-hMNen  ,  U2„2\MN 


<  2e~nMNe(l  +  h2cr)MN . 

Now  choose  h  =  — ,  therefore  for  large  M  and  N 

j  j  M  IV 

S  EU(™,n)cos(ma)cos(n0)\  >  e} 


771=1  71=1 


<Ce  (MN)^e/2  (c  is  a  constant). 

Let  K  =  M2N2,  choose  K  points,  9r  =  (<*i,  ft), . . . , 

9k  =  (<xk,Pk),  such  that  for  each  point  9  =  (a,  /?)  6  (— tt,  7t),  we  have  a  point  9j 
satisfying 

lai  -  a|  +  \Pj  ~  P\<  ^ 


Note  that 


M2N2 


1  l  M  N 

\jjjj  H  U{m,n){cos(Tna)cos{np) 

771=1  71=1 


—cos(maj )  cos  ( nfij ) }  | 


<C 


1  M  N 


Er — '  MN  .  . 

Lt 72^.1™ +  n\ 


MN^^MW 
as  M,N  — ►  oo. 


Therefore  for  large  M  and  N,  we  have 


1  I  M  N 

P{S^NML^U{m'nU 
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X 


cos(ma)cos(n(3)\  >  2e} 

i  1  M  N 

<  P{  max  |  — —  y2U(m,n) 

j<M2N2  '  N  M  "  “  v  ' 

m— 1 n=l 

cos(maJ)cos(n/3,j)|  >  e} 

<  CM2N2e~{MN^(/2. 


Since  t2e  1  <  oo,  from  Borel  Cantelli’s  lemma,  we  have 

1  j  M  N 

SUP  I Iv ~M  ^  ^  U(m,n)cos(ma)cos(n/3)\  ^4  0 

a,/J  m  m=i  n=1 


Therefore, 


^  M  N 

SU?  ^"/V  A?  ^  ^  e(ro,  n)cos(ma)cos(n/?)|  ^4  0 

a,0  iv  iKI  m_ln=1 

Since  P  <  oo,  Q  <  oo  and  |6(z,j)|  <  oo,  it  proves  the  lemma. 


Para. 

~LSE" 

MSE 

ASV 


LSE 

MSE 

ASV 


LSE 

MSE 

ASV 


Table  1 
=  AT  —  in 


A2 

^1 

^2 

P 1 

/i2 

3.998 

5.001 

2.000 

2.500 

1.000 

1.500 

1.14E-3 

6.30E-4 

7.22E-6 

2.15E-6 

6.60E-6 

2.05E-6 

1.41E-3 

5.04E-4 

6.04E-6 

1.38E-6 

6.04E-6 

1.38E-6 

4.000 

4.998 

2.000 

2.500 

1.000 

1.500 

5.75E-3 

3.12E-5 

8.96E-6 

3.12E-5 

8.05E-6 

5.64E-3 

2.01E-3 

2.42E-5 

5.53E-6 

2.42E-5 

5.53E-6 

3.992 

4.999 

2.000 

2.500 

1.000 

1.500 

1.25E-2 

6.02E-3 

6.63E-5 

1.87E-5 

6.27E-5 

1.82E-5 

1.27E-2 

4.53E-3 

5.44E-5 

1.24E-5 

5.44E-5 

1.24E-5 

3.989 

5.005 

2.000 

2.500 

1.000 

1.500 

2.15E-2 

1.00E-2 

1.16E-4 

3.55E-5 

1.08E-4 

3.38E-5 

2.26E-2 

8.06E-3 

9.67E-5 

2.21E-5 

9.67E-5 

2.21E-5 

r 


Table  2 
M  =  N  =  20 


<T 

Para. 

A\ 

^2 

^1 

A2 

A*2 

.25 

LSE 

4.000 

5.001 

2.000 

2.500 

1.000 

1.500 

MSE 

1.24E-4 

5.48E-4 

3.81E-7 

1.11E-7 

3.69E-7 

1.16E-7' 

ASV 

3.53E-4 

1.26E-4 

3.78E-7 

8.64E-8 

3.78E-7 

8.64E-8 

.50 

LSE 

3.999 

5.002 

2.000 

2.500 

1.000 

1.500 

MSE 

5.48E-4 

3.38E-4 

1.57E-6 

3.77E-7 

1.65E-6 

3.61E-7 

ASV 

1.41E-3 

5.04E-4 

1.51E-6 

3.45E-7 

1.51E-6 

3.45E-7 

.75 

LSE 

3.997 

5.004 

2.000 

2.500 

1.000 

1.500 

MSE 

1.65E-3 

8.00E-4 

3.15E-6 

8.81E-7 

2.94E-6 

9.91E-7 

ASV 

3.17E-3 

1.13E-3 

3.40E-6 

7.77E-7 

3.40E-6 

7.77E-7 

1.0 

LSE 

4.000 

5.005 

2.000 

2.500 

1.000 

1.500 

MSE 

2.33E-3 

1.37E-3 

6.82E-6 

1.72E-6 

6.63E-6 

1.71E-6 

ASV 

5.64E-3 

2.01E-3 

6.04E-6 

1.38E-6 

6.04E-6 

1.38E-6 

Table  3 
M  =  V  =  30 


[i!l 

to 

Ai 

^2 

A*i 

A*2 

.25 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

5.37E-5 

3.93E-5 

8.19E-8 

2.15E-8 

7.96E-8 

1.99E-8 

ASV 

1.57E-4 

5.60E-5 

7.46E-8 

1.71E-8 

7.46E-8 

1.71E-8 

.50 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

2.16E-4 

1.51E-4 

3.09E-7 

8.27E-8 

2.80E-7 

7.79E-8 

ASV 

6.27E-4 

2.24E-4 

2.98E-7 

6.82E-8 

2.98E-7 

6.82E-8 

a 

5.003 

2.000 

2.500 

1 

MSE 

5.31E-4 

3.76E-4 

6.55E-7 

1.75E-7 

7.19E-7 

1.69E-7 

■ 

ASV 

1.41E-3 

5.04E-4 

6.71E-7 

L54E-7 

6.71E-7 

1.54E-7 

LSE 

— 

2.000 

2.500 

1.000 

1.500 

MSE 

7.13E-4 

1.21E-6 

3.22E-7 

1.24E-6 

2.97E-7 

ASV 

2.51E-3 

8.95E-4 

1.19E-6 

2.73E-7 

1.19E-6 

2.73E-7 
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